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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

. Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 
. If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 
• If NO period for reply is specified above, the maximum statutory period wit) apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply wiO. by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment See 37 CFR 1.704(b). 

Status 

1 )|3 Responsive to communication(s) filed on 18 April 2005 . 
2a)S This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1 935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1.2.4-24.26.28.29.32-38 and 40-45 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. ^ /~2jt~Z^ d6j 32- - 3§ tyO-H-f 

6) ^ . Ciaim(s) 1 30.32 38.40 U is/are rejected. } 

7) D Claim(s) is/are objected to. 

8) G Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

1 0) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .1 21 (d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
Priority under 35 U.S.C. §§119 and 120 

12) Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a>n All b)\J Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

13) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application) 

since a specific reference was included in the first sentence of the specification or in an Application Data Sheet. 
37 CFR 1.78. 

a) □ The translation of the foreign language provisional application has been received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 since a specific 

reference was included in the first sentence of the specification or in an Application Data Sheet. 37 CFR 1 .78. 
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DETAILED ACTION 

Claim Rejections - 35 USC§103 

1. Claims 1,2,4,5,6,7, 8, 1 1-18, 24, 26, 28,29, 32, 33, 36,37,42,44 and 45, are rejected under 
35 U.S.C. 103(a) as being unpatentable over the combination of Rtischeve/a/ in view of Kahn et 
al (6122614) In further view of Baker et al (4783803V 

As per claims 1, 2, 5, 7, 36,37 and 45, Rtischev et a/.teach: 
a means for hearing at least one person who is repeating items (spoken-language 
instruction apparatus employing speech recognition with user reading words from a written script 
from an inherent database, Abstract; user and microphone, or user and telephone, Fig. 1, 
elements 12 and 16, or elements 12 and 14, respectively); and 

means for preparing a transcription of what was heard by the means for hearing (as input 
speech being transcribed - col. 5 lines 5-27) 

means for comparing the items with a transcription of what was heard and thus measuring 
intelligibility from the comparison (speech recognizer using nonlinear HMM speech models, Fig. 
3, element 1 12; preselected script, element 1 14; score set, element 120; reading errors, col. 3, 
lines 43 and 47). 

A measurement unit operable to determine an intelligibility score of the speaker by 
comparing the items and a transcription of what the listener hears when the speaker repeats the 
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items (as FSM comparing the resubmitted sentence after determining the previous result wasn't 
satisfactory (col 6 lines 54-67) 

Rtischev et al. also teaches evaluations using data selected from at least speaker 
responses and items (col. 3, lines 11-17). 

As per claim 8, the Areading errors= (col. 3, lines 43 and 47) of Rtischev et al inherently 
include at least word substitutions, for an error in reading a word could cause the ASR to 
interpret it as a different existing word (e.g. a Japanese reader using Rtischev et al apparatus to 
learn English might pronounce Aframe= as Aflame=, which would cause the ASR to recognize 
the spoken word as the latter). 

As per claims 1, 2, 5, 7, 36,37 and 45, Rtischev et al does not explicitly teach a human 
listener preparing the transcription without prior knowledge of the text that is being spoken, 
however, Kahn et al (6122614) teaches a human operator transcribing an audio file (col. 8 lines 
19-28) and performing a secondary comparison between the audio file and the initial 
transcription (col. 8 lines 29-35; fig. 2c). Therefore, it would have been obvious to one of 
ordinary skill in the art of speech transcription to modify the teachings of Rtischev et al with 
operator based transcription and double-checking because it would advantageously allow for 
human interpretation of the audio file without tying time resources of the user themselves (Kahn 
etal, col. 1 lines 17-26). 
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The combination of Rtischev et al in view of Kahn now teaches a system wherein the 
user's input is transcribed (Rtischev et al, as input speech being transcribed - col. 5 lines 5-27), 
the user's input being compared to a transcription (Rtischev, as FSM comparing the resubmitted 
sentence after determining the previous result wasn't satisfactory (col. 6 lines 54-67); wherein 
the one transcription come from a human operator placed between the user and the system (Kahn 
et al (6122614) teaches a human operator transcribing an audio file (col. 8 lines 19-28; the 
operator manually inputs the words that the operator "perceives to hear")). 

The combination of Rtischev et al in view of Kahn does not explicitly teach the automatic 
recognition of the operator's interpretation of what is heard (that is, the claim elements require 
the operator to speak what is heard; whereas the combination of Rtischev et al in view of Kahn 
requires the operator to type what is heard). Baker et al (4783803) , however, teaches a 
microphonic input for a user to input speech for recognition ( Baker et al (4783803) , col. 6 lines 
20-26), wherein the output is in word text format and is allowed to be edited by the user ( Baker 
et al (4783803), col. 45 line 54 - col. 46 line 4). Therefore, it would have been obvious to one of 
ordinary skill in the art of speech recognition at the time the invention was made to modify the 
system combination of Rtischev et al in view of Kahn with automated speech recognition of the 
operator's interpretation of the user's input because it would advantageously speed up the 
recording process of the operator's perceived translation (as opposed to typing the translation 
manually), ( Baker et al (4783803) , col. 1 lines 13-20). 



As per claims 4,6, 8, 1 1-13, 15-18, 24, 26, 28,29, 32, 33, 42, and 44, the combination of 
Rtischev et al in view of Kahn et al (6122614) in further view of Baker et al (4783803) teaches 
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listening to the speaker (Kahn et al (6122614),v ia the recorded audio file of the user - col. 8 lines 
19-28). 

As per claim 14, Rtischev et al in view of Kahn et al (6122614) in further view of Baker 
et al (4783803) does not explicitly teach selecting listeners based on certain background 
characteristics. However, it would have been obvious for an artisan at the time of invention to 
select listeners that have extensive background speaking knowledge of the language being 
learned because they would be best able to determine the intelligibility of someone trying to 
speak the language. 

2. Claims 9, 10, 19, 20-23, 34, 35, 38,40-41, and 43 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over the combination of Rtischev et al in view of Kahn et al (6122614) in 
further view of Baker et al (4783803) , as applied to claims 1, 2, 5, 7, 8, 36, and 37, above, in 
view of Charles Lewis et al (U.S. Patent 5,059,127, issued October 22, 1991). 

As per claims 9, 10, 19, 20-23, 25, 34, 35, 41, and 43, while Rtischev et al in view of 
Kahn etal (6122614) in further view of Baker et al (4783803) teaches evaluating an error count 
intelligibility score ( Rtischev et al ,reading errors, col. 3, lines 43 and 47), they do not evaluate 
difficulty of the items and ability of a listener, nor doing this using Item Response Theory. 
However, Lewis et al do (col. 1, line 63 through col. 2, lines 1, 16-26, and 42-43, with 
Figure 1A). 

It would have been obvious for an artisan at the time of invention to do this because 
Lewis et al teach that IRT Aallows creation of a test in which different individuals receive 
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different questions, yet can be scored on a common scales as well as Apermits determination in 
advance of test administration of the level of ability and the accuracy with which ability has been 
measured^ (col 2, lines 31-36). 

The rest of the limitations were discussed in connection with the rejection of claims 
1, 2, 5, 7, 8, 36, and 37, above. 

As per claim 38, Rtischev et al in view of Kahn et al (6122614) in further view of Baker 
et al (4783803) does not teach a database containing data from previous evaluations. However, 
Lewis et al teach retaining data from previous Atestlets= and Asequentially administering 
testlets ... until a pass/fail decision can be made= (Abstract), thus suggesting retaining results of 
previous intelligibility evaluations (testlets) for later continued evaluation. It would have been 
obvious for an artisan at the time of invention to do this, to avoid having to administer all the 
testlets in a single sitting. 

As per claim 40, Rtischev et al suggest use of nonlinear artificial neural net models for 
speech recognition (see reference to Kim et al under AOther Publications^ on the front page, 
top of second column). 

Response to Arguments 



3. Applicants arguments filed 1 1/4/2005 have been fully considered but they are not 
persuasive. Applicant's arguments presented on pages 3-4 of the response repeat the arguments 
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that were presented in the office action above. With respect to the arguments on the bottom of 
page 4, examiner argues that the Kahn reference teaches the human operator repeating 
information by the process of typing. The bulk of the arguments presented on page 5 of the 
response repeat what is admitted in the office action. The argument presented on page 5 that 
Kahn fails to show measuring intelligibility, examiner argues that the applicant is arguing a 
result , and not the actual apparatus or function. As per applicant's arguments against the Baker 
reference, examiner argues that the Baker reference is introduced to automate the operator's 
transcription process. The arguments presented in the first foil paragraph on page 6 of the 
response, the user of Baker is the operator in Kahn. The arguments presented on page 6-7 of the 
response (as well as previous arguments presented) have dissected the references, and has not 
treated the references as a combination. In response to applicants arguments against the 
references individually, one cannot show nonobviousness by attacking references individually 
where the rejections are based on combinations of references. See In re Keller, 642 F.2d 413, 
208 USPQ 871 (CCPA 1981); In re Merck & Co., 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 
1986). 

Conclusion 

4. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1. 136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
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will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1. 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael Opsasnick, telephone number (571)272-7623, 
who is available Tuesday-Thursday, 9am-4pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mr. Wayne Young, can be reached at (571)272-7582. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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